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3174.1012-001 ^T eSS W U f el No.£^££537///7^ 

Date: (MJfyft IManage 433466 

Method for High Resolution Fingerprint Capture and Identification 

Field of the Invention 

includes^e 1 !^'? 168 * *" fie,d of automatic ^gerprint image analysis, and 
dentifiLfon T v ^ erpnm acc l u,s,tion > «^rprint enrollment and fingerprint 
.dentificat on. It applies, ,n parhcular, to the automatic analysis of high resolm on 
fingerprmt .mages that reveal pore structural features and ridge deviation IZt Z 
addition to standard minutiae structures g aeviation details in 



Background of the Invention 

Growing concerns regarding domestic security have created a rrihVal n „A * n 

EE? id T¥ in f vidua,s as ,egitimate ho,ders * «i ?S2. dSSiSL? 

passports and other forms of identification. The ideal identification process s reliable 
fa* and relatively inexpensive. It should be based on modern high speed elects 

shoui? at r netWOrkCd t0 Cnab,e f3St Md CffeCtive A^offataSn 
should also be compact, portable, and robust for convenient use in a «f 

environments, including airport security stations, customs and border clsinT l- 
vehicles, home and office computing and entrance control sites of secure bSgs'. ' 

A well established method for identification is to compare a fingerprint with a 
rraonakar, Handbook of Fingerprint Recognition", Springer 2003 chanter 1 ^ 

H v tra ? iti0nalIy b f " C0 " eCted by ro]l ^ *W fmge on a whi paper 
InZl I K 0nal Pr ? CCSS Clearly fai,S 10 meet the cri *ria listed above nl"^^ 
attempts have been made to develop an electronically imaged fingerprint meS ?o 

security check pomt, on a secure but portable or removable storage devLTr^ ^tSv 

wide and can extend in a swirl-like pattern for severaf mm to one 8 " 2 cm m riLs 

3 ^ ridge - Va,Iey P Cri0d ^ approximately 250" 
Zt'^VT\ m Cr0SS SCCti0n ' ™& in diameter fr ™ about 50 um to 250 urn 
and are a igned along the ndges. The patterns of both ridges/valleys and pore are 
beheved to be umque to each fingerprint. No currently available lo^SZcurrint 
acqu,s,t,on technique is able to resolve pores. Accordingly presen °Z^om^ ^ 
fingerprint unification procedures use only ridge and valley patterns There a e 

EST ° f rid8eS ' CaUed SUC " 38 ^poin" dlS: ds 

bifurcations, crossover points, and islands, which are found in almost every fingerprint 
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20o1 t Tl? i ^ J t; and Prabh ? kar ' " Handb00k of Fi «8^rint Recognition", Springer 
2003, chapter 3 ) Extraction and comparison of minutiae is the basis of most cu^ent 
automatic fingerprint analysis systems. 

There are several important limitations with minutiae-based methods of automatic 

n 5 oth° C0,,e H eno , ugh ? inutiae for re,iab,c • 

m^ SUbS ; qUent,y SC r ^ the inked into an electronic data bale This 

he geometrical arrangements between minutiae points vary from imaseto irnL of thl 
^me finger. In addition, forensic applications can involve ^mall, pT^a, X„, 
prints that contain relatively few resolved minutiae so that reliable anaS ha^d ™ „ 
limited number of minutiae points is quite difficult 

eo.,IH h! 1 ""!!? T Pari ? n ign ° reS 3 s 'Sn'fieant amount of structural information that 

fS^XtmpZr^ 

SSSS^J^ 1,11386 S T° ' USCd 3 COmin0n prism - based configuration, a 
nign resolution CCD video camera, and a macro lens to provide the resolution ne^n \ n 

identified ^ * ^ 3 Skdet0n ^ from w h*h ™iae anTpore™ 

identified. Fmgerpnnts are compared by independent correlations between cores and 
minutiae extracted from the various images P Md 



AU . Summary of the Invention 

Although the procedure of Stosz and Alvea is mefiil f™- w, n u »• • 

resolution fmgerpnnts that do not have resolved pores. Their process which ^7™. 
ridges to contour lines through binarization and thinning, alsoSstfolaZ 
regarding ndge shape ma, could be used to aid fingerprint ^"f^ 4). 

and the position, shape and prominence of pores. 8 contours, 

f.n B ernrin U t r f P T ed T " ™ aUt ° matic fmgerprint recognition method that identifies 
fingerprint features by using gray-scale gradient edge detection techniaues The 
echmques identify and trace edges of structural fealres to At 
sufficiently high resolution the ridge outlines contain structural fea3h"cT^ 
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hi fingerprint matching. This capability improves matching reliability over systems that 
reduce ndge patterns to a few minutiae types, or consider ridges only as simple contou 
lines Because of the richness of features in fingerprints at high resolution our procedTe 
produces reliable matchmg of small prints. The procedure analyzes an unaltered gray- 
scale .mage of the fingerprint to reduce both computing time and false accept rates. In a 
preferred embodiment edge detection software is combined with high resolution image 
acqu,s,t.on technology that is capable of resolving pores and ridge profiles. 

Description of the Invention 

mfl t^,nl h n nVenti ° n c ° m P rises L f w L ° ma J' or steps; fingerprint enrollment and fingerprint 
matching. During enrollment a high resolution digital fingerprint is acquired and features 

F IT" 8 , T §e ^ Wi " * USCd f0F Subse < Uent ^W** matching are identified 
Fingerprint matching compares features from two fingerprints and decides if the two 
prints are from the same individual. The source for these two prints can be a data base of 
h gh resolution fingerprints, a live scan image, a legacy data base of lower resolution 
prints, or latent fingerprints, or combinations of these sources. 

Fingerprint Enrollment 

A block diagram of the fingerprint enrollment process is presented in Figure 1 
Fingerprint matchmg is described latter in the application. 

Fingerprint Enrollment 



Acquire Image 



c 



I 



Transfer Image to local or remote computer 



Convert image to desired format, add header information and watermark J 



I 



Construct a Trained Model (s) 



C 



Compress and encrypt (optional) both image and model 

l 



Save Image and fingerprint model in data base 



] 



Figure 1 A flow diagram of the enrollment step of the invention:. The blocks 
bold type are further broken down in additional flow diagrams in Figures 3 and 4. 



in 
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Fingerprint Acquisition: 

Although our procedure can improve the analysis of low resolution fingerprints it 
■ j particularly useful for the ana.ysis of high resolution images that show pc e a" 

plh Z I' ^^n^ : t0 dCteCt 8 fm ^ T ' mt > ( Maltoni > Maio, Jain, and 
Prabhakar, chapter 2). Our preferred method of acquiring high resolution f ngerorinte is 

™ a . : 2 ' Whl( ? 18 mcoi T ,orated b y ^rence herein in its entirety. This 
method uses the device shown in Figure 2. 



Finger 



Cover plate 



Holographic grating | \ 




Figure 2. Holographic waveguide fingerprint imager 









Electronic camera 





The key components of the image acquisition device of Figure 2 are a reading 
hght source, a substrate that acts as a waveguide for the read lightfa hotogSiSmL 
a cover plate, and an electronic camera. Reading light, usually from a low^ower oMode 
aser, is directed onto the entrance face of the subsume waveguide at t cTses 

bteS ° Th e the substrate by totaI ^ r " * SSSST 

Eel?H m *J 1 1\ bCam iS diffraCtCd fr ° m ^ ^ ide at a near no ^l angtto 
the guide surface by the holographic grating. Fresnel reflection of the diffracted light at 
the coverplate directs some of the diffracted light back through the hologram throfgh the 
substrate wavegu.de, and onto the entrance face of the electronic cameraTfl St 
the cover plate ,s suppressed at locations where objects come into optical contact Zh the 

When a finger is pressed onto the cover plate the ridges of the fingerprint will 

T"? "? SUPPreSS refleCti ° n - W P° res « dqm-SSSSSSSta. 
Aere will be reflection from the coverplate at pore locations. The resulting imfge of thf 
finger that is presented to the digital camera comprises light areas for the vaS and 
<U : ridges with light pores aligned along the ridges. An ^distorted fijSSSff 

S? t ^ a^T" ^ bC CaptUred by the camera if me re ^ing liglu that is 
diffracted by the hologram is collimated and has a uniform wavefront 

l a h nra t,lT eC,f,C eX ^r ,e ° f f™* Sh ° Wn in ^ 2 that has bee " «sed in our 
laboratory to successfully acquire high resolution fingerprints uses a laser diode that 

emits 5 mW of light at 652nm. The glass waveguide has an entrance face foleter 

4 
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mm £2 '5 I T "??c C ° f 60 fr ° m the horizonta1 ' its dime ™<™ are 36 

mm long 2.5 mm tiiick and 25 mm wide; the 1 mm thick square coverplate is 25 x 25 

mm. to , th ,s example the image is captured by a CMOS electronic imager having a 1024 

I 6 1 mm^ I *™ Tf PiXe,S , and 256 gray ,evels - The size of *« resulting image 
.s 6.1 mm by 7.7 mm while ,ts resolution is 167 pixel per mm or 4200 pixels per inch 

^n^r 15 „ 3 ^ r ! SOlUti ° n fin 8 er P rint was acquired with the device ' 
described above according to the method of Figures 2 and 3 is shown in Figure 4. The 
hght valleys and dark ndges with their associated bright pores are easily revived 
Examples of pores, ndges, ridge details, and minutiae are all indicated in the figure 

£m£T tyPW ° f featUreS ^ b£ USCd by 0W ~ e * ~d match 



Acquire Image 



Direct light beam through 
substrate block ' 



/ — — : 

Press finger onto the con 


r 

" 

tact area of the coverplate 


T 


Adjust the exposure tin 


leof the digital camera 



Capture Image 



ridge profiles 6 * A aCqUiSiti0 " ° f 3 fmgerprint with reso,ved P°™ 
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.,V-.-: \ . ■ y 



r " 0 r 





•'■ -- I - - -■ ' ,J . . 1 



^^^^ 



Figure 4. A fingerprint image acquired with the apparatus of Figure 2 according 
o the procedure outlined in Figure 3. The valleys are light and the idgS are Zl whh 
hght creular pores. The image contains less than 10 minut iae and almost 1^ tuts » 

serial ATA, or Ethernet. The image is then converted to a desired file format and header 
» forma ion and possibly a watermark are added to the image. The hea^w„"ontatn 
^formation regardmg the fingerprint and how, when and where it was acquired .Id 

lformation about the individual 

One example of a procedure to add a watermark to finserorint imaae S i< Ju. 



pointers to related information such as personal information about the indlvTai 
.ncluding, but not limited to, a photograph, voice print and other identiCg intn 

>ni subsequent unauthorized alte „ 

Yeung and Pankanti, "Verification ii^S^i&tS^ 
ournal of Electronic Imaging, 9(4), 468-476(2000). CoLerciXCZktg 
procedures, such as those of Digimarc Corporation, can also be used. 8 

Construction of Fingerprint Model 

in. ,t ^ ftCr 3 fui SfT™t is acquired specific and unique features of the print are 

•den ified^xtracted and stored as a "trained model" according to the pS shown in 

Figure 5. The model will be used for subsequent fingerprint verification ( one to one 
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matching) by comparing the feature sets of the model to the corresponding features of a 
subject .mage Features from the entire image are usually extracted^ ^ stored fo ' 
fingerpnnts that are to be used for fingerprint identification ( one fo m^tchmg) 



Construct a trained model 



/ 

Construct a mode, for at .east two resolution levels; a .ow reso.ut.on "outJine" mode, and a high^ 

resolution "details" model y 




f . JZL_____z 


i 




Choose one or more regions of the fingerprint image to use for the model 




r 








in each of the selected regions of the fingerprint and at each of the chosen resolutions 
use gray-level, gradient edge detection techniques 
to KJenbfy, outline, and extract ridge profiles and pore features 


J 



Optional: Manually add, extend, or delete features 

; r— — - 

Optional: Identify features that must be present for a match 

^ _ 



for ^5^™^ 3 ^ ° f 3 *— ' - - 

compnses ridge contours, ridge shapes, and pores. De.aHs T^Z ridge LpT^d 
pores are generally not considered in the outline model- commre IW I f™ , 

SI P 7 ? n / mal ma8e: each P' xel of the sufe set is an average value over a 
predetermined number of neighboring pixels from the original image. iSt step 
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£S. fmg ? T hi " 8 " t0 COmpare outline mode,s - ^ches that are discovered at 
the outline level are then compared at the details level. ^covered at 

Images acquired by the device shown in Figure 2 are 6. 1 mm bv 7 7 mm Thic 
relatwely arge fingerprint is usually divided into one or 

md^dually used to construct a composite model. These smaller regionscleither be 
chosen manually to capture particularly interesting features or thev can be cho^n 
automatically using adjustable software settings that define h nSZS^S re fi ion 
jze, and locations. Their size is chosen to be large enough to include num oT 

deZ T C and , t0 bC Sma " en ° U ^ h 10 ^uce problems assorted with plastic 

deformation of the skm and to minimize computation time. The features identS^T 
ub region of the complete fingerprint are referred to as a feature «£JS5££ 
comprises a collection of all of the feature sets for a particular fingerprint 

Feahires for each resolution level, and in each region of the fingerprint chosen to 
b part of the tramed model, are identified and extracted using gray-levfS entX 
detection procedures. The gradient is first estimated for each ofth pixels of the model 
using one of a relatively large number of procedures that have biSSSlSf 
process (see for example D. A. Forsyth, and J. Ponce, "Computer Vision A Modern 

tSSSTv^S HaU u ^ JefSey> 2 ° 03 ' Ch3pter 8 ' ° r P F - Wh -.-d D Molloy 
Mach „e V,sion Algorithms m Java", Springer, London, 2000, chapter 3 ) A 

particularly usefiil procedure that is often used to estimate grad ents is to apply a 

"fmS 0186 fi ' ? ' I 0 th t image ™ d ^ t0 Perf0m the £*- S ing a 
finite differences" algorithm. After calculation of the gradients an image point wkh a 

m£nS2ZTf*Z ^ nei 8 hborin 8 ed 8 e P°^- This is usually 
accomphshed by finding the nearest pixels to the original edge point that lie in a direction 

Se JZT^H- perpe " diCU , ,ar t0 the ^ nt directiontha^ passes through S 
edge point. The gradient values for these new pixels are determined and the oixel Vkh 1 
^adient that ,s maxima, along its gradient direction and has a valued t et eeds I 
Uireshold is assigned to be the next edge point. This procedure is conned eTmer until 
the edge is termmated or the edge closes with itself to form a 

termination occurs at the previously determined edge point if the gradient of a candidate 
edge pouit .s less than the threshold. In the next step a previously unvisked e^o nt u 
•dentified and its edge is traced according to the steps outlined XTto S lEo^L 
, repeated until all of the potential edge points haveVen SES Automat c ? 
software procedures are then used to distinguish fingerprint features from Zs Real 
edges for example, must define features that have a minimum width. In addi t on 1 nes 
to* do not enclose pores must extend for a minimum distance in order to be con£Z 
as Iegmmate feature edges. Additional rules are applied by adjustin^o^ 
Optional steps allow the models to be manually edited by adding SlSfa„ d 

m TaT h ^ ?*" fCatUreS ° f the m0dd that must b ^ of a^ccei&l 
match. All ed,ting .s performed on the features and not on the original image wS s 

ddibemtely protected from any alteration. Examples of features that Sntffie b this 
procedure are shown in Figures 6, 7, and 8. oy mis 

inH, A' A T?? 0t > ommercial software applications can be used for edge detection 
mcludmg Aphelion from Amerinex Applied Imaging, Hexsight software from Adept 

Source " *" USA by LabS ' and Ha,i ° n from 



8 
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scheme with a compression ratio n fno tL. » vuamization (WSQ). This is a lossy 



matching procedures The trains m rt ^i 77 UMU * II,n 8 ana tor some automatic 



requires 
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scussea in the text. Tnese features were obtamed at the "details" level of resolution: 



10 
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subsequent fingerprint matching steps. Noise is traced in bluTand tm Z t a * 
c . Fingerprint Matching 

Fingerprint Verification 
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Enter user identification 



Fingerprint Verification 



[ Acquire live scan ftngerprim 



Retrieve trained model for user 



x 



7 



Select outline version of the first feature 
set of the model 



select next outline feature 
set of the model 




Extract outline features from the 
| Live scan image 



Correlate outline features from the live scan 
image and the model 




Proceed to match 
details level 



resolutiS. 9 ' A fl ° W diagram ^ StCpS f ° r ***** verification at the "outline" 

A user first presents identification such as a name or oasswnrH n« * i 
high resolute fingerprint of the user is acquired anHuS^W f 7 
the complete print are identified according to the procedure^ T fcatUres f ° r 

described above. An outline feature JZT? , ,f* e present ime *™ 
the corresponding feat! „ flZS * e & ™ ^ * C0B * wd to 
either a match is found or all of th fZl^eTa^J V^t 01 " ' S rCpeated Until 
live scan outline features If a match* foun Z l h been ""^ to 

procedure is repeated at ~J *" * 
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Match Features at the details level 



Select the detafls version of the next feature set 
of the model 




| Select details feature set from trained model | 






| Correlate "details" features from image and model 








level. 



Figure 10. A flow diagram for fingerprint verification at the "details" resolution 
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Fingerprint features are correlated according to the procedure shown in Figure 11. 



Fingerprint feature correlation 



Overlay a feature set of the model on a portion of the live scan image 

— )~~ 



Determine the correlation between the model feature set and the features of 
the overlain portion of the live scan image 



Translate the model feature set to overlay a fresh 
part of the live scan image 




No match 



Figure 11. A flow diagram outlining the procedure used to determine if » m »^h 
exists between a trained model and a live scan fingerprint. * 

resolution^dl^f Fi§U : e 1 1 b ° th the 0Utline Md detai '* ^els of 

211^ " n Veriam 0n 3 featUre set of the enti * »ve scan image 
Since the model feature set is smaller it will overlap only a portion of the live scan 

feature set. A correlation is then calculated between the model feamre set Z Abortion 

of the live scan image that it overlays. There are a number of procXe^aJe 

Apa^^ 

their "cross correlation" (for example Maltoni, Maio, Ta S ™I ^£S3& 
Fingerprint Recognition", Springer, 2003, chapter 4). Using this procSe the ct? 
corre ation between the live scan image and the mode. tJ^E&S a the 
feature set expands, contracts, and rotates, over predetermined limits wTresoect to th e 
hve scan tmage that it overlays. The feature set is then translated ££S£2£ 

14 
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Z XZT? f u " COrre,ati ° n Calcu,ation is re P eated - ™» Process is followed 
for all the feature sets of the model. A match is achieved if a cross correlation mST 
threshold, and ,f a predetermined percent of required features match * 

Fingerprint Identification 

Fingerprints from an unknown individual can sometimes be identified bv 
comparmg the unknown print to a data base of known prints. A particularlVadvantaeeous 
procedure is to compare prints in a data base of high resolution LgerprmI Z wlrf 

3nd P r0CeSSCd aCC ° rding 10 the Pr0cedures of 1, 3 y 5 whh a hS 

resolution unknown print. In this case each print in the data base would have both af 
assocated "outlines" and "details" feature set that encompassed the entire fingemr^t 

reanire sets of the data base. To save computation time the comparison would first be 

M 0 h hne " Tt ti0n ,eVel ThC SUbSBt 0f matched at oSine 

level would subsequently be compared at the "details" resolution level 

in ei th, Vt al K° P °T ble t0 C ,° mpare 3 rdativeIy low reso,ution unk "own print to prints 
in either a high or a low resolution data base In these cases the feature set for the 
unknown print would comprise only ridge patterns, and would noSS itation on 
ridge profiles, ridge shapes, or pores. Our procedure should exhibit enhanced Kb nty 
over mmutiae-based systems even in this case since all of the information of the win 
would be used for comparison and not just a few minutiae points P 

nrrrJH ° f fm S er P rin t identification appropriate linear scaling might be 

necessary smce the unknown fingerprint may have been acquired at a differenf 
magnification from the fingerprints in the comparison data base 
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